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Abstract 

This letter introduces a niechanism for constructing, through a process of dis- 
tributed decision-making, substrates for the study of cohective dynamics on extended 
power-law weighted networks with both a desired scaling exponent and a fixed clus- 
tering coefficient. The analytical results show that the connectivity distribution 
converges to the scaling behavior often found in social and engineering systems. To 
^ I illustrate the approach of the proposed framework we generate network substrates 

that resemble steady state properties of the empirical citation distributions of (i) 
publications indexed by the Institute for Scientific Information from 1981 to 1997; 
(ii) patents granted by the U.S. Patent and Trademark Office from 1975 to 1999; 
and (Hi) opinions written by the Supreme Court and the cases they cite from 1754 
to 2002. 

^1 Keywords: complex networks, weighted digraphs, extended power-law distribu- 

tions. 



1 Introduction 

Understanding structure lies at the very heart of the study of complex networks. A 
network is a collection of a large number of interconnected elements (units or agents) 
whose interaction with each other and with the surroundings leads to characteristic 
properties that can only be attributed to the network as a whole ^J. Networks often 
develop distinct structural steady state patterns. Studying these patterns, promises to 
enhance our understanding of the dynamics underlying collective human responses [2j, 
corrupt behavior [3], and economic development fl]. 

Random graph models fail to capture key features of real- world networks {e.g., clus- 
tering coefficients and degree correlations). Recent efforts to understand network struc- 
ture have focused on connectivity distributions underlying a number of social and engi- 
neering systems which, rather than following the Poisson distribution of random networks 
(bounded by Chebyshev's inequality), have heavy tails [5J. Heavy-tailed distributions in 
empirical data suggests the existence of causal mechanisms that shape the structure and 
function of real- world networks [B]. In the era of "big data," the development of formal 



1 



frameworks that quantify patterns of interaction of networks has set the research agen- 
das across various disciphnes {e.g., more recently across the data driven computational 
social sciences). 

Power-laws, a particular type of heavy-tailed distributions, have received significant 
attention in recent years. For a network with an extended power-law connectivity dis- 
tribution, if the number of connections of a node is much larger than xq, the probability 
that the node connects to x other nodes is proportional to for some positive con- 
stants a and xq [Z]- As a result, the tail of the distribution has no exponential bound and 
the connectivity of the nodes of the network comprises different orders of magnitude, 
with a few nodes being highly connected. 

Key to modeling power-law networks is the characterization of hubs (highly inter- 
connected nodes). In the context of the spread of disease, measuring patterns in regions 
that are more vulnerable to infection (hubs) allows us to respond more effectively to the 
potential spread of large-scale epidemics [8j. The ability to understand and recreate the 
structure of epidemic networks allows us to design strategies that embrace how inter- 
connected regions influence one another (as a result of the evolution of social systems) 
in order to quantify and predict the dimensions of disease. 

To capture the relationships between the elements of a network, e.g., duration, emo- 
tional intensity, or intimacy, models define weights as an inherent property between 
nodes [9]. Recent models of weighted networks have focused on attachment strategies 
in which nodes are added according to probability distributions on the existing weights 
across the entire network. The network model introduced in [lOj captures the evolu- 
tion of weights driven by preferential strength attachment, a mechanism in which newly 
added nodes are more likely to connect to nodes associated with larger weights. Lacking 
local competitive factors between nodes, the resulting networks exhibit power-law dis- 
tributions where the hubs correspond to the nodes that have been part of the network 
the longest. 

This letter introduces a wide class of attachment strategies which promote the for- 
mation of hubs based on both the length of time a node has been part of the network 
(i.e., node longevity) and its ability to compete for weights with surrounding neigh- 
bors (i.e., node fitness). Because the connectivity dynamics of the nodes depend on 
their attractiveness to compete for weights (as in |11]). older nodes are not necessar- 
ily more successful in acquiring weights. To our knowledge the proposed mechanism is 
novel in that it generates weighted directed networks with extended power-law strength 
distributions {i) in a distributed fashion (decision-making strategies are based on local 
information; we do not assume any type of global information to generate the desired 
network structure); {ii) for an arbitrary scaling exponent a > 2 and a fixed clustering 
c G (0, 1) (as in [12j); and {iii) for values greater than a particular threshold s > (for 
the case when only the tail of the distribution obeys a power-law). 

The remaining sections are organized as follows. First we introduce a model that 
captures the connectivity and growth dynamics of the gradual addition of nodes to an 
existing network component and proposes attachment strategies for local rearrangement 
of weights between pairs of nodes. We prove that for any connected network there exists 
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a distribution of the total weight from neighboring nodes (node strength) that is asymp- 
totically stable (i.e., the proposed strategies lead to a Nash equilibrium [l3]). Moreover, 
as the network grows, consecutive achievements of this network state leads to weighted 
directed networks with extended power-law strength distributions and distinctive clus- 
tering coefficients (defined as the ratio of the total average weight of transitive triplets 
over the total weight of possible triplets). We present simulations that capture the effect 
of node fitness and illustrate the application of the proposed model to generate various 
citation networks. Finally, we draw some conclusions and future research directions. 

2 A model of network topology and growth 

Consider a directed network that captures weighted relationships between a set of nodes. 
As the network grows, more nodes join the network, each possessing a small "budget" 
used to construct directed links to some existing nodes. When, node i establishes a 
link to node j (by passing some of its budget to node j) node j has more budget to 
spend, which it may do by increasing its weighted connections to other nodes. Broadly 
speaking, every node wishes to spend its budget, but the more it spends the less willing 
it is to spend more. Nodes will locally rearrange their weights until every node reaches 
an equilibrium. At the equilibrium all nodes have associated gains that are equal and 
there are no further incentives to rearrange connections. 

To formalize this idea let us introduce the following notation. Let Tii = {1, . . . , A'^i} 
be a finite set of nodes at generation k = 1. Nodes represent elements (acting units) 
that establish connections to other nodes. We represent the relationship between nodes 
using a weighted matrix Wi = [wij]j\fixNn where Wij € M_(. = (0, oo) quantifies the 
relationship between node i and j. If Wij > 0, then there exists some kind of action 
from i to j with weight Wij. It may capture, for instance, the extent to which node i 
infiuences node j. Let Qk = (^fcj VVfe) represent the network at generation k (because in 
general Wij ^ wji, the network is modeled as a directed graph). For a fixed generation, 
let p{i) = {j : Wji > 0} represent all nodes which influence node i (incoming neighbors). 
Similarly, let q{i) = {j : Wij > 0} represent all nodes influenced by node i (outgoing 
neighbors). A gain function gi{si) is associated to each node i G Hk and characterizes the 
marginal beneflt that results from its current set of connections, where Sj = wji, 
Si G M+. Note that Si is a scalar that represents the incoming strength of node i (referred 
to as node strength hereafter). The following network assumptions are needed: 

Al Finite network strength: The total weight of the initial network Pi = Y^^=i 
Pi G M-|_, is flnite. In other words, the extent to which any node in the network 
can be influenced by other nodes is bounded. 

A2 Connectedness: Every node is influenced to some extent by another node. At each 
generation k, Si > e > 0, Vi G Hk- 

A3 Bounded marginal gains: The gain function gi{si) > associated to node i G Tik 
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satisfies 

^ 9i{yi) -9i{zi) , , 

-ai< < -bi (1) 

Vi - Zi 

for any yi,Zi G R+, yi ^ Zi and some constants > ftj > 0. In other words, 
the marginal gain associated with each node decreases with increasing strength. 
Equation ([1]) ehminates the possibihty that a very small difference in node strength 
may result in an unbounded change in gain. Note that if gi is differentiable and 
has a negative derivative it satisfies eq. ([1]). 

Next, we use t > to specify the time index of events. Let t = be the time instant 
when a new node is added to form the network [i.e., the start of generation k). Let 

be the instant right before the new node is added to {i.e., the start of generation 
k When t = Tk+i, Gk evolves into Qk+i- For generation k let the set of states 




be the simplex over which the connectivity dynamics evolve. Constraints on our model 
below will ensure that for all nodes i G T-Lk., s{t) G Sk for all Tk < t < Tk+i- We assume 
that as t — >■ r^, the time allowed for the events that drive the connectivity dynamics 
during generation k goes to infinity. Let s{t) = [si{t), . . . , SN,,{t)]^ G be the state 
vector for Gk at time t (i.e., the incoming strength distribution of the entire network). 

2.1 Connectivity dynamics 

We first focus on the dynamics of s{t) for Tk <t < t^+i (i.e., within a fixed generation). 
In particular, we want to define the singleton 

Sk = {s e Sk ■■ for all i,j G Hk, gi{si) = gj{sj)} (2) 

such that any strength distribution that belongs to this set represents a distribution 
where all nodes in T-ik have equal gain levels. To capture the connectivity dynamics 
that lead to SI, let e^^fl represents the decision of node i to weaken its relation from 
some nodes j in p{i) while strengthening its relation to other nodes in T-Lk- Let the list 
= {aj{i),a.t{i), . . . ,(7j"{i)) such that j </<••• < /' and ,. . . ,j" G V-k be 
composed of elements crj{i) that denote the weight to be added or created to the to 
link ujij between node i and node j G Tik. For convenience, we will denote this list by 
a{i) = {(Jj{i) : j G 7ik)- Similarly, let the list {fJ.j{i) ■ j G p{i)) be composed of elements 
that denote the weight to be subtracted from the link Wji where node j G p{i). 
Let denote the set of all possible combinations of how node i can weaken 

or strengthen its relations to other nodes. Let the set of events be described by £i = 
^ ('"-^MO-'') ~ ("^(O denotes the power set). We call ei{t), Tk < t < Tk+i, events 
of type 1; they drive the connectivity dynamics within a network generation. Notice 
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that each event ei(t) € £i is defined as a set, with each element of ei{t) representing 
the potential rearrangement of multiple weights between nodes, and multiple elements 
in ei{t) representing the simultaneous rearrangements among multiple nodes. 

An event ei{t) may occur only if it belongs to the set defined by an enable function 
hi : Sk — y — {0}) specified for node i € 'Hfc as follows 

- If gi{si) > gj{sj) for all j G q{i), then e^|^j G ei{t) such that a{i) = (0, ...,0) 
and = (0, ... ,0) is the only enabled event. Hence, node i does not modify its 
relationships to others nodes (i.e., the strength of node i does not change). 

- If gi{si) < gj{sj) for some j G q{i), then the only e^|*| G are ones with 
a{i) = {(Jj{i) : j G Hk) fJ-ii) = {fJ-jii) '■ j ^ such that 

CI '^^■W = E 

j&Hk jep{i) 

C2 aj*{i) > —7 igj*isj*) - gi{si)) 

for some j* G {j : gj{sj) > grisr), for all r G q{i)} and 7. The parameter 7 G (0,1) 
regulates the speed at which weights are rearranged and affects the transitivity of the 
network (i.e., if a node j is connected to node / and node / to node j", the probability 
that node j is also connected to node j"). Low values of 7 lead to slower convergence 
processes which increase the probability of forming transitive triples and lead to higher 
clustering coefficients. 

Condition CI implies that a node can only establish or strengthen its relations to 
other nodes by weakening incoming weights (the sum of incoming weights must equal 
the sum of outgoing weights). It implies that Qi~ conserves total network strength, i.e., 
Pk = Xli^i Si(0 is constant. To interpret C2 and C3 it is useful to remember that 
reducing (increasing) the strength of a node always increases (decreases, respectively) 
its gain. Both conditions constrain how nodes can modify their weights in terms of the 
gain of outgoing neighbors. Condition C2 implies that if the gain of node i differs from 
any of its outgoing neighbors, then the relation to some neighbor with the highest gain 
must be strengthened by some amount. Condition C3 implies that when node i weakens 
incoming weights, node i cannot exceed the highest gain of at least one outgoing neighbor. 
Together they guarantee that the highest gain of the network is strictly monotonically 
decreasing over time (as we prove in Theorem 1). 

Next, state transitions are defined by the operator /i : Sk — > Sk where ei{t) G £1. 
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For a fixed generation k, if ei(t) G hi{s{t)), e^Y^l € ei{t), then s{t + 1) = fi{s{t)), where 



Equation Q means that the strength at node i at time t + 1 equals the strength of node 
i at time t, plus the total weight added by the nodes that strengthened their relationship 
to node i, minus the total weight reduced by nodes that weakened their relation to node 
i at time t. 

Let El denote the set of all infinite sequence of events £i . Let denote the sequence 
of events ei(0), . . . ,ei(t — 1) and let the value of the function S{s{0), E^ ,t) denote the 
state reached at time t from the initial state s(0) by the application of the sequence Ej 
of events of type 1. We assume that each event of type 1 occurs infinitely often on each 
event trajectory EjE^, Tk <t < Tk+i- This assumption is met if nodes persistently try 
to rearrange weights. The enable function hi together with state transition operator fi 
define the evolution of the connectivity dynamics of the network. 

2.2 Growth dynamics 

We now turn our attention to the evolution of the network as it grows. To capture a 
nodes's advantage of longevity let ki be the generation when node i is added and define 
nj = ^ as the fraction of generations node i has not been part of the network component. 
Moreover, to capture a node's competitive advantage in acquiring weights we associate 
to every node a fitness /3j, where /3j S (0, 1). Let sq > be a constant amount of strength 
such that Si > sq. Let the gain function (marginal utility) associated to node i £ Hk 
during generation k be 



Higher values of /3j characterize nodes that are more attractive in the sense that they 
can carry more weight without greatly reducing their gain. Both high values of rii 
(representing the fact that node i has been part of the growing network for only a 
few generations) and low values of /3i (representing the fact that the node has a low 
competitive advantage for acquiring weights) have a negative effect on the gain of node 
i. Below we will see how /3j allows us to define the scaling exponent of extended power-law 
strength distributions. 

Let e'^^*) represents the attachment of a new node i to the network at the beginning of 
generation k (when t = Tk). Let m = o'.r(i) be the total (constant) weight of a newly 
added node. A node attaches to the network component by (i) randomly distributing 
its weight a{i) across some nodes and (ii) establishing a non-empty set of incoming 



Siit + l) 




(3) 




(4) 
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neighbors {i.e., some node must connect to it). We call the attachment of nodes to Qk, 
k = 1,2,... events of type 2. Let £2 = {e'^^*^} denote all possible combinations of how 
node i can attach to the network component. An event 62 (/c) G £2 may occur if it is 
defined by an enable function /12 : Sk — > e'^^^\ specified for a newly added node as 
follows 

- Node i attaches to the network only if the associated gain function gi{si) follows 
the general form of Q with longevity and fitness parameters that satisfy 

C4 ni = l 

C5 /3i = /3 Vf G Tik 

Condition C4 follows from letting ki = k for the newly added node (at generation k node 
i has been part of network for one generation). Condition C5 specifies an equal fitness 
value for every node (as is the case for networks with linear growth under preferential 
attachment). 

The transition 62 (A;) G S2 is defined by the operator /2 : 5^ — > Sk+i- If 62 (fe) G 
h2{s{Tk)), then s(rfc+i) = /2(s(t^)) where Si{Tk+i) = m only if node i is the newly 
added node. Let E2 denote the set of all infinite sequence of events £2- Let Ef, denote 
the sequence of events of type 2, 62(1), ... , e2{k). We assume that each event of type 2 
occurs infinitely often on each event trajectory Ef,E'^. The assumption is met if nodes 
constantly attach to the existing network component. The enable function /12 together 
with the transition operator /2 define the growth dynamics of the network. 

3 Analysis 

Next, we present stability properties of the invariant set 5^ and deduce the average gain 
level of the network Qj.. We then prove that, for values greater than a threshold s, the 
strength distribution converges to a scaling behavior. 

Theorem 1; Suppose Al-3 and Cl-3 hold. Then is an invariant set and has region 
of asymptotic stability equal to Sk. 

Theorem 1 guarantees that for any generation k, initial network state s(0), and event 
sequence Ej, S{s{0), E^ ,t) as t ^ Tk+i for generation k. Broadly speaking, the 

conditions in Theorem 1 capture the dynamic coupling between different nodes that lead 
to a Nash equilibrium. By attaining the same gain level no node can increase its gain 
by changing its connections unilaterally without making the average gain of all other 
nodes worse off. When is reached the average gain of the network an instant before 
the start of generation /c + 1 is given by 

Ck = ^ E 9^{s^{r^)) (5) 

As the network grows, the behavior of the average gain is characterized by the following 
lemma. 
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Lemma 1: Suppose Al-3 and Cl-5 hold. Moreover, \/k let s{t^) G then — >• 
l/{m + so)(l — /3) as k ^ oo. 

Lemma 1 implies that at the desired strength distribution 5^, the average gain tends 
to Ck — 7- l/(m + so)(l — (3) as k ^ oo. 

The following theorem implies that as the network grows, it develops an extended 
power-law structure driven by the marginal benefit of the allocation of weights across 
nodes and quantifies the value s above which the scaling behavior emerges. 
Theorem 2: Suppose Al-3 and Cl-5 hold. Moreover, V/c let s(t^) G S^.. Then the 
strength distribution P[si — sq > uj] of the network Qk{T~^k-,y^k) follows an extended 
power-law with scaling exponent a = 1/ P + 1 as k ^ oo. The scaling behavior holds for 
values greater than s = (m + So)(l — /?). 

Note that if sq = the model yields power-law rather than extended power-law 
distributions (as in preferential attachment with linear growth) for values greater than 
m(l ilOj. 

Extended power-law distributions emerge as a result of both the interaction between 
local mechanisms that lead to Nash equilibria and the continuum attachment of new 
nodes to the network. In particular, when the network is at a Nash and a new node is 
added, it introduces a perturbation to the existing set of strategies. Conditions Cl-3 
force the network to return to a state which again represents a Nash, with subsequent 
achievements of Nash equilibria shaping the structure of the network. 

4 Simulations 

To gain insight into the connectivity dynamics let (3 = ^, m = 1, sq = 0, Ni = 2, 
and consider a network after k = 1000 generations. Figure [1] shows the value of the 
clustering coefficient c = X^ta'^/^t'^ {i.e., the ratio of the total average weight of 
transitive triplets over the total weight of possible triplets) as a function of the size. 
Note that for any 7 £ (0, 1) the clustering properties remain constant as the network 
grows. Figure [2] shows the effect of varying node fitness, where /3j is chosen from a 
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Figure 1: Clustering coefficient as a function of network size Nk at various values of 7 
and as a function of 7. 
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uniform distribution with support (0,1). Figure [^h- shows the evolution of the node's 
strength for different values of Note that Sj(r^) follows a power-law for all values of 
/3j ~ U{0, 1). Because of their competitive advantage, there are some nodes with more 
strength Sj which have been part of the network for only a few generations. It is possible 
for a node to join the network at a more recent generation and become more attractive 
than other nodes that have been part of the network for longer. In particular, fig. [2^ 
shows that the node added at generation k = 105 with /3io5 = 0.9 overcomes older nodes 
with /355 = 0.6 and /Ss = 0.3. In fig. [2)3, the cumulative strength distribution for the 
entire network suggests a power-law with a logarithmic corrective term similar to the 
theoretical prediction in ^JJ where p^i ~ lo ]w) ^~^^~^'^*^ with C* = 1.255. Finally, fig. E] 




^2 3 1 2 3 

10 10 10 10 10 

Generation, k Strength, oj 



Figure 2: (a) Evolution on the strength of three nodes added to the network ^looo using 
fitness /Ss = 0.3, fS^^ = 0.6, and /3io5 = 0.9 from /3j ~ C/(0, 1) with m = 30 and sq = 
when a = 1. (b) Cumulative strength distribution P[si > a;] Ei{—C* log(a;)) or 
p^^ ~ Tog^"^ *'^^'^*^ where Ei{x) is the exponential integral function (i.e., a power-law 
with an inverse logarithmic correction term emerges). 

shows empirical data on the citation distribution of articles indexed by the Institute 
for Scientific Information (ISI); patents granted by the U.S. Patents and Trade Office; 
and opinions written by the U.S. Supreme Court and the cases they cite. Figure [3^ 
illustrates the case for scientific papers published in 1981 and cited between 1981 and 
1997 [14J. The authors of [6] estimated both the scaling exponent a* = 3.16 and the 
threshold s* = 160 it 35 at which the scaling behavior emerges. Figure represents 
citations on the main subnetwork of U.S. patents granted between 1963 and 1999 and 
references made to these patents between 1975 and 1999 [TJ]. Figure shows the 
majority opinions written by the U.S. Supreme Court and the cases they cite from 1754 
to 2002 [TB]. All three citation networks follow extended power-law distributions (for 
the last two examples we estimate the values of a*, s*, and c* from empirical data). 

^For the paper citation network we use the data and the distribution predicted by the model intro- 
duced in [B]. For the U.S. patent citation network we use the data presented in [K] and the distribution 
predicted by the model introduced in [3 with a = 4.9 and s = 9.6. For the U.S. Supreme Court citation 
network we use the data presented in [16] and the distribution predicted by the model introduced in [7] 
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Figure 3: Cumulative probability distribution P[si — sq > co] for (a) the paper citation 
network presented in [6j; (b) the U.S. patent citation network presented in [15]; and the 
U.S. Supreme Court citation network presented in [16] . 



Finally, we compare the distributions from empirical data with the distributions 
predicted by the proposed and previous models 0, [7]. We measure the greatest dis- 
crepancy between the empirical and the expected distribution (D-statistic), as well as 
the sum of squares of the deviations between the two distributions. Table [1] summarizes 
the model parameters and the results. Note that the performance of other (perhaps 
simpler) models degrades when the entire range is considered. 

5 Discussion 

The proposed model generates extended power-law distributions from consecutive achieve- 
ments of stable strength distributions <S^. Although it does not pretend to empirically 
validate real-world mechanisms behind citation networks, the model may be of interest 
in the following context. First, it can be shown that the state 5| is a Nash, which im- 
plies that when a network reaches the equilibrium there is not any node that can gain by 
unilaterally rearranging weights to neighboring nodes (there are no incentives to change 
or establish new relationships). By focusing on the dynamics that drive the network 
to we capture the coupling between different nodes, characterizing how relationships 
between any pair of nodes affects other nodes in the network. Second, the proposed 
strategies allow us to control the connectivity dynamics of nodes based on local attach- 
ment strategies (Cl-5), allowing us to generate network substrates through distributed 
decision-making. Finally, the ability to control the rate at which attachment strategies 
lead to the scaling behavior allows us to obtain non-negligible clustering coefficients for 
large networks. 

We focused on two types of network incentives: (i) Longevity rewards nodes that 
have been part of the network for a long time (they have the ability to acquire more 

with a = 4.1 and s = 35 respectively. 
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Table 1: Model parameters for the three citation networks. 







Papers 


Patents 


Court cases 




Nodes 


783339 


240547 


30288 


Empirical 


Links 


6716198 


561060 


220500 


network 


a* 


3.16 


4.68 


4.29 




s 


160 it 35 


8 it 2 


55 it 20 




C 


Not available 


U.UO 1 


n 1 n7 


Generated 


a 


3.13 


4.63 


4.25 


network 


s 


13.3 


7.2 


40.8 


model 


c 


0.713 


0.044 


0.112 




m 


7 


2.9 


7 


Model 


so 


18 


7 


44 


parameters 


/3 


0.47 


0.28 


0.31 




7 


0.5 


0.98 


0.93 


D-statistic 


Proposed model 


0.2792 


0.1656 


0.1761 




Previous models^ 


0.9910 


0.3681 


0.2995 


Sum of squares 


Proposed model 


0.7358 


0.0599 


0.0499 




Previous models^ 


2.3829 


0.1416 


0.1803 


Range 




[160, 8904] 


[0, 173] 


[0, 248] 



weight compared to recently added ones); (ii) Fitness rewards nodes that are highly 
competent (they are more suitable to compete and maintain weights). Modeling nodes 
with varying fitness allows "latecomers" to overcome nodes that have been in the network 
for longer generations. 

Following similar ideas as in Theorems 1 and 2, the proposed framework can be 



n particular, if we consider 
where k > 0, the proposed 



extended to generate exponential strength distributions, 
the gain function of the general from gi{si) = j- In ^ + i 

strategies lead to weighted networks with P[si > w] ~ e~^. A mathematical framework 
that allows us to generate various strength distributions for different domain intervals 
provides an important direction for future research. 

6 Appendix 

Proof of Theorem 1. First, we define a metric p{s^ S^) on the distribution of the strength 
and a Lyapunov function V{s). We then show that for the choices of p(s,(Sp and 
V{s), V{s) = for s G >S^ and there exist two positive constant ci and C2 such that 
cip{s,S^) < V{s) < C2p(s,<S^) for all s G Sk. Finally, to prove asymptotic stability 
of SI we show that for any initial distribution s{0) ^ 5^ and any class of rewiring 
strategics that satisfy Cl-3, i.e., for all such that E^E^ G E^{s{0)), the functional 
V{S{s{0),El,t)) ^ as t ^ DO for any fixed generation A;. 
Let s' = [s'l,..., SjVfc]^ choose 

p{s,Sk) =ini{ma^\si- s'i\: s' € SI} (6) 

and ^ 

V{s) = iaax{gi{si)} - ^ Yl ^ji^j) (7) 
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Note that for s £ S^, V{s) = since gi{si) = gj{sj) for all i,j G "Hfe and p{s,S^) = 0. 
To show that V{s) is bounded from below by a class /C function cip{s,Sl), note that 
according to eq. ([T|) for all Si G (0, cxd) and all i G Tik, it must be the case that for any 
s ^ SI and s' & S^, there is some node i G Tik such that Sj / s^. Let 6 = minj{6j} and 
ci > be a constant such that 

S^^'^^-Sf^ < -b. < -6 < -i- = -c, < (8) 

Since eq. dH) applies for any i G such that Si ^ s'^, it must apply for some node 

r = argmax{|sj — : Sj 7^ s^} (9) 
Using the definition of p{s,Sl) and applying eq. Q to node r yields 
bp{s,Sl) < 6max{|si - s-| : Si / s-} 

= b\Sr - s'rl < \gr{Sr) - gr{s'r)\ (10) 

Note that for any strength distribution s ^ S^. and s' G 5^ , one of the following must 
be true: In the first case, if gr{sr) — griK) > Oi i-^-) if node r needs more weight from 
its neighbors to achieve the desired state, then there must exist some other node u such 
that 

gu{su) - guis'J < (11) 

In other words, there must exist another node u that needs to weaken its relationship 
to neighboring nodes to achieve its desired state s'^. Because, gu{s'u) = gris'r) and 

9r{Sr) > gu{Su) 

gr{sr) - gr{s'r) < S'r(sr) " S'«('S«) < max{gi{si)} - mm{gi{si)} 

i i 

Similarly, if gr{sr) — gr{s'^) < 0, i.e., if node r needs to weaken its relationship to 
neighboring nodes to achieve the desired state, then there must also exist some other 
node u such that 

gu{su) - gu{s'u) > 

In other words, there must exist another node u that needs to strengthen its relationships 
to achieve its desired state s'^. Because gu{s'u) = 9r{s'r) 

< gr{s'r) - gr{Sr) = gu*{s'u) " 5'r(Sr) 

< gu{Su) - gr{Sr) 

< max{gi{si)} - mm{gi{si)} 

Thus, eq. PU]) can be bounded from above by 

bp{s,Sl) < max{gi{si)} - mm{gi{si)} (12) 
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Next, note that 



V{s) > maxgi{si) - 



> 



m.m{gi{si)} + {Nk - 1) max{gi{si)} 
max{gi(sj)} - mm{gi{si)} 



Using eq. p2|) we get 



max{gi{si)} - mm{gi{si)} 



<V{s) 



(13) 



Thus, V{s) > cip{s,Sl) for all s £ Sk- 

Next, we will show that there exist a constant C2 such that V{s) < C2/o(s,5^) for all 
s £ Sk- Let a = maxjjaj}. Recall that for all s ^ SI and s' € SI, max{|sj — > 0. 
Note also that if r = argmaxj{(/j(sj)}, then according to eq. ([T]) 



< 



maxi{gi{si)} - gr{s'r) 



max{|sj - s[\} 
and similarly, \i u = argminj{(7j(sj)}, then 

9u{s'u) - va.m.i{gi{si)} 



< a 



< 



< a 



max{|sj - s-|} 
By adding eq. (fH|) and eq. (fT5|) get 

I max,{5i(si)} - gr{s'r)\ + \9u{s'J ~ mm{g,{s,)}\ 



(14) 



(15) 



2a > 



> 



max{|si - s'J} 
I max,{5i(si)} - 9r{s'r) + guis'J - mm,{g,{si)}\ 



max{|si - s-|} 
Since s' G 5^, gu{s'J = gr{s'r) and 

maxi{gi(sj)} - Tm\ii{gi{si)} 



max{|si - s[\} 



< 2a 



Moreover 



V{s) < max{gi{si)} - —{Nkm.m{gi{si)}) 
< max{gi(si)} - imn{gi{si)} 



Hence, if C2 = 2a 

V{s) <C2max{\si- s[\} (16) 
Since eq. applies to any s' G S^ and s ^ S^ and according to the definition of 

V{s) < C2 inf{max{|sj — s[\} : s' G SI} = C2p{s,Sl) (17) 
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Thus, V{s) < C2p{s,Sl) for all s G 5^. 

Next, in order to show that is globally asymptotically stable, we must show that 
for ah s(0) ^ 5^ and ah such that EjE^ G E'^{s{0)), 



(i.e., 1^—7-0 along all possible motions of the system). This part of the proof is similar 
to the proof of Theorem 3.4 in [17]. If s{t) ^ S^, then there must exist some node 
r € Hk with the highest gain among all nodes (there might actually be more than one). 
There must also exist another node u G Tik such that {u,r) G Wk and Quisuit)) < 
gr{sr{t)). Because of the restrictions imposed by E^, we know that events of type 1 
are guaranteed to occur infinitely often. According to condition C2, when each event 
of type 1 ei(t) occurs, the gain of node r is guaranteed to decrease by a fixed fraction 



7 G (0, 1) of grisrit)) - gu{suit)). Heucc, if e'^r G ei(t), then gr{sr{t + 1)) < gr{sr{t)). 



Regardless of how many nodes with the highest gain there are, since there are only a 
finite number of nodes in the network Q^, it is inevitable that eventually the highest 
gain must decrease. Note that according to condition C3 no node can increase its 
gain beyond the gain of the highest nodes by weakening its relation from neighboring 
nodes. In other words, ma,Xi{gi{si{t))} must eventually decrease as long as s{t) ^ 5^. 
Note also that since 'Ylii^u^dii^i^^)) > 0' the Lyapunov function can be bounded by 
< V{s{t)) < niaxi{gi{si(t))} . Hence, for every t > 0, there exists t' > t such that 



V{s{t')) > V{s{t' + 1)) as long as s{t') ^ 5^ so that V{S{s{0), E^ ,t)) ^ as t ^ oo, 



Proof of Lemma 1. We show that Vi G Tik the value of Ck converges as A; — > oo. Let 
s(r^) G S^. Using Theorem 1 we know 



Following assumption A2 for each generation k, Mi G T-ik then Sj — sq > e > 0, so we 
have 



V{S{s{{)),El,t)) ^ as t ^ oo 



(18) 



and has a region of asymptotic stability equal to Sk- 



□ 





1 



e(l-/3) 
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Next, consider the difference in average gain between two consecutive generations 



Cfc — Ck~ 



+ k ^ Si - sn\ki m + A; - 1 . 4^ 



1 fk-l^^ 



ni + k .j-^ Si - So \ki J m + k-l f-^ Si - sq 

1 1 f 1 ^-^ 1 /k-1^^ 



y^— -) — - — y 

^ Si - sn V 7 m + A; - 1 



ni + k .f-f Si - So \ki J ni + k - 1 Si - So \ h 

k-1^^ 



> 

Moreover, 



ni + k-lsN,{T^+i) - so V k 



1 ^ f k\^ 



1 I fk-lY ^ I 



e(ni + A;-1)\V k J ' ^ \ 

Because linifc^oo (i^) = 1 and limfc_,oo Yli&ik ^^~if~^''^ = 

lim Cfc - = 

Let Coo = liiiifc-i-oo Cfc. Because the weight added at the start of each generation is 

constant and , 1. ( ) = — — ( ) = Ci,, o € 'Kh such that s G 5?, using 

eq. ([U and eq. dJD we know 

m = Pk- Pk-i 

= y^ {si{T^) - So) - X] ~ ^o) 

1 ( k I ^ (k^ -{k-l) 
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letting A; — > oo, yields 
m + sq = lim 



fc— >oo \ Cf^^i \ k — 1 



-y 



1 



lim . 

fc— >oo c7fc_i \k — 1 



k 



lim 



_ (A; - 1)/^^ 



lim 



1 



+ 



1 



lim 



1 



As A; ^ oo, the average gain is given by 

1 



1 + 



/3 



1-/3; Coo(l-/3) 



(m + so)(l-/3) 



(19) 



□ 



Proof of Theorem 2. Because of the restrictions imposed by E'^E'^, we know that events 
of type 2 occur infinitely often (i.e., new nodes are persistently added to the network). 
Using Theorem 1 and according to eq. ([2]) and eq. dH Vi G T-Lk 



1 



■Si(Tfc ) - So ^ 1 



Because n,- = -t^ we know that 



which indicates that the strength of any node i follows a power-law distribution over 
generations. Following similar ideas as in [18], the probability that a node has strength 
Si — Sq smaller than u is 



P[Si -so<uj]=P 



Cfc V ki 



So < UJ 



l^C^^V+io)^ 



where ki (i.e., the generation at which every node is added to the network) follows 
a probability density function /cj ~ C/(l, A:). To characterize the emergence of scaling 
behavior note that 



kj k 



p 



ki > kC-^'\uj + so 



l-C^"\u: + so) 
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The strength distribution is given by 



dP[si - so<uj] 



dP 



dijj 



If we let k ^ oo, then 



= ^cj {oj + so)-" 



(20) 



which leads to an extended power-law distribution with a = + 1. 

Following similar ideas as in [T9] we now characterize the value at which the power- 
law emerges. The general expression for a power-law exhibits 

Pu. = Coj-'' 

where the normalization constant C can be expressed as C = (a — l)s"~^, then 



1 



(a — l)s 



a-1 



Using eq. ([IHD, eq. ([2U|) and eq. PT]) we have 



a - 2 

s = (m + so)(l - /3) = -{m + sq) 

a — 1 



(21) 

(22) 
□ 
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